Tactical Conflict Solver Assisting Air Traffic Controllers Using Deep Reinforcement Learning
نویسندگان
چکیده
To assist air traffic controllers (ATCOs) in resolving tactical conflicts, this paper proposes a conflict detection and resolution mechanism for handling continuous flow by adopting finite discrete actions to resolve conflicts. The solver (TCS) was developed based on deep reinforcement learning (DRL) train TCS agent with the actor–critic using Kronecker-factored trust region. agent’s are determined ATCOs’ instructions, such as altitude, speed, heading adjustments. reward function is designed accordance control regulations. Considering uncertainty real-life situation, study characterised deviation of aircraft’s estimated position improve feasibility schemes. A DRL environment actual airspace structure density operation simulation system. Results show that 1000 test samples, trained could 87.1% samples. rate decreased slightly 81.2% when increased factor 1.4. This research can be applied intelligent decision-making systems control.
منابع مشابه
Reinforcement Learning of Traffic Light Controllers Adapting to Traffic Congestion
Due to the increasing amounts of traffic in and around urban areas there is a growing need for intelligent traffic lights that optimize traffic flow. In this paper we describe the optimization of traffic light controllers using a multi-agent, model-based reinforcement learning or approximate real-time dynamic programming approach. Our methods optimize individual traffic lights locally, but the ...
متن کاملUsing a Deep Reinforcement Learning Agent for Traffic Signal Control
Ensuring transportation systems are efficient is a priority for modern society. Technological advances have made it possible for transportation systems to collect large volumes of varied data on an unprecedented scale. We propose a traffic signal control system which takes advantage of this new, high quality data, with minimal abstraction compared to other proposed systems. We apply modern deep...
متن کاملTactical Decision Making for Lane Changing with Deep Reinforcement Learning
In this paper we consider the problem of autonomous lane changing for self driving cars in a multi-lane, multi-agent setting. We present a framework that demonstrates a more structured and data efficient alternative to end-to-end complete policy learning on problems where the high-level policy is hard to formulate using traditional optimization or rule based methods but well designed low-level ...
متن کاملRobotic Controllers for Navigation using Reinforcement-Learning
Understanding the human brain and its behaviour is the main aim of Neuroscience, therefore forming a model with the objective of imitating a special biological behaviour, like the ability to learn, is a research problem with many potential applications. This thesis aims to present a simulation of the Morris water maze [22] using a robot in order to compare two different Reinforcement Learning t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Aerospace
سال: 2023
ISSN: ['2226-4310']
DOI: https://doi.org/10.3390/aerospace10020182